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@ System for configuring a shared storage. 



^ A shared storage configuration system for use in a computer system includes a plurality of processing 
modules each having at least a main storage unit, a central processing unit and a connection unit for 
connection to a system bus and a plurality of shared storage modules each having a shared , storage unit 
and a connection unit for connection to said system bus. The space inherent in said processing 
modules is accessible by physical addresses of said central processing unit of each of the processing 
modules. The shared storage space is accessible by the physical addresses of said central processing 
unit of each of the processing modules. 
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Background of the Invention 

1. Field of the Invention 

5 B The present invention relates to a a system for configuring shared storage and a shared storage dup- 

licating system for use with a multiprocessor system in which processor modules and shared storage modules 
are connected by a system bus. 

2. Description of the Related Art 

10 

A shared storage device of a multiprocessor system stores instrucUons and data necessary for processing 
by multiple processor modules. These processor nrradules frequently access the shared storage device. If the 
frequency of access to the shared storage device is high, the number of processor modules which can be built 
into the system will be limited and consequently, the system's performance will be limited. Furthermore, abnor- 
75 mality in one processor module is apt to be directly linked to abnomnality within the whole system. Thus, a shared 
storage configuration system is desired which permits efficient access to the shared storage device and dec- 
reases access frequency. 

Specifically, a shared storage for a fault tolerant system requires duplicating. However, as the duplex con- 
figuration of the shared storage is specified fixedly by hardware, flexible control is not allowed in duplicating 
20 the configuration. Besides, in accessing a duplex memory, the software monitors the access as a duplex 
access, thus being subject to a large process load caused by a duplex write. Therefore, an Improved duplicating 
method is in great demand which allows a change in a duplex configuration and a reduction in load on software 
during the duplex access. 

A conventional multiprocessor system comprises a plurality of processor modules and a plurality of shared 
25 storage modules which are connected by a system bus for transfer of information, thereby forming a computer 
system. 

In such a multiprocessor system, instructions and data necessary to a central processing unit of each pro- 
cessor module are stored in the shared storage modules. Hence, each processor module fonms a TCMP (Tightly 
Coupled Multiprocessor) system which frequently accesses the shared storage modules. 
30 Besides a shared storage duplicating method is indispensable for realizing a fault tolerant multiprocessor 

system capable of continuous operation even when a fault occurs in a part of the system being operated. 

A duplex configuration of a conventional shared storage Is detemiined by the hardware, and an abnomnal 
condition in one of the duplex storages is con-ected immediately by a duplicating write where the same data 
are written, according to a write Instruction of a processor based on the software, Into a pair of shared storage 
35 modules specified as a duplex. 

With IheTCMP system in which each processor module frequently accesses the shared storage modules, 
however, there Is a limit to the Infonmatlon transfer capability per unit time of the system bus. Thus, if the number 
of accesses Increases, the number of processor modules which can be built Into the system will be limited to 
a considerably small number Consequently, system performance will also be limited. 
40 In implementing fault-tolerant computer system whfch is able to continue functioning without going down 

even when a fault occurs in part of the system, problems which arise with the conventional system in that, if 
an abnormality occurs in one processor module due to an access error, the system bus will be released after 
a delay with the result that overheads occur in the other processors due to the extremely frequent access to 
the shared storage rrwdule, which may cause an abnormality of the whole system to be liable to occur 
45 Moreover, in the conventional system, the memory area accessible by the central processing unit of a pro- 

cessor module is limited by the physical addresses of the central processing unit, and thus the area outside 
the physical address capacity cannot be used as a merrwry space area. Therefore, it has been extremely dif- 
ficult to build a computer system that requires vast noemory space, for example, one for processing a large-scale 
data base. 

so However, shared storage duplication in a fault-tolerant system does not require duplication of all memory 

areas, but perfonms duplication only of specific memory areas as required. 

However, In the duplicating nrwthod in the prior art technology, the duplex configuration of a shared storage 
is determined fixedly by the hardware. Therefore, if the size of the memory areas to be used during the dup- 
licating process fluctuates during system operation, the system must be stopped so that the duplex configu- 

55 ration can be changed by the hardware. This causes a problem in that the duplex configuration cannot be 
determined flexibly. 

In the duplicating method of the prior art technology, software recognizes a duplex access on accessing 
a duplex memory and monitore the state of the access until data are written twice in the duplex shared storage. 
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Thus, the load on the software becomes large and system efficiency is reduced. 
Sumniary of the Invention 

5 An object of the present invention is to provide a shared storage configuration system for a computer system 

which penmits efficient access to a shared storage device so as to improve system performance, fault-tolerant 
requirements to be met and memory space to be Increased. 

Another object of the present invention is to realize a shared storage duplicating method for a fault tolerant 
computer system where a duplex configuration can be changed during operation and the load on the software 

10 can be reduced during a duplex access. 

A feature of the present invention resides in a shared storage configuration system for use in a computer 
system including a plurality of processing modules each having at least a main memory unit, a central proces- 
sing unit and a connection unit for connection to a system bus and a plurality of shared storage modules each 
having a shared storage unit and a connection unit for connection to the system bus, comprising: space inherent 

15 in the processing modules which is accessible by physical addresses of the central processing unit of each of 
the processing modules and shared storage space which Is accessible by the physical addresses of the central 
processing unit of each of the processing modules. 

Another feature of the present invention resides in a shared storage duplicating method for specifying a 
shared storage module corresponding to another shared storage module where a duplex configuration is 

20 defined by assigning an inverted value at a specific bit of the unit ID to each other in a computer system conr>- 
prising: a plurality of process modules having at least a main memory, a central processing unit, and a con- 
nection unit for connection to a system bus; and a plurality of shared storage modules having at least a shared 
storage unit and a connection unit for connection to the system bus, wherein shared storage space accessible 
dependent on a physical address is divided into plural parts of partially-shared storage space; the existence 

25 of a duplex configuration of the shared storage module is defined for each part of the partially-shared storage 
space; and another shared storage module having an inverted value at a specific bit in its unit ID in contrast 
with the unit ID of the shared storage module where a duplex configuration is defined is specified as a con-e- 
sponding module in a pair of storage nnodules. 

30 Brief Description of the Drawings 

Figures 1 A to IE are diagrams for explaining the fundamentals of the present Invention; 
Figure 2 ilustrates a multiprocessor system configuration of the present invention; 
Figure 3 Is a block diagram of a processor module of the present Invention; 
35 Figure 4 is a block diagram of a shared storage module of the present invention; 

Figure 5 is a block diagram of a connection unit of the present invention, which is built in the processor 
module; 

Figure 6 Is a block diagram of a connection unit of the present invention, which Is bulit in the shared storage 
module; 

40 Figure 7 is a diagram for explaining transfer cornmands on the system bus according to the present inven- 

tion; 

Figure 8 is a diagram for explaining writing and transfer operations according to the present invention; 
Figure 9 is a diagram for explaining reading and transfer operations according to the present invention; 
Figure 10 is a diagram for explaining an address space map according to the present inventksn; 
45 Figure 1 1 is a diagram for explaining extended SSL) space according to the present invention; 

Figure 12 is a diagram for explaining SSM configuration definitions by the first control register according 
to the present inventk)n; 

Figure 13 is a diagram for explaining SSM configuration definitions by the second control register according 
to the present invention; 

50 Figure 14 is a diagram for explaining packaging of the shared storage modules corresponding to the con- 

figuration definitions of Figures 12 and 13; 

Figures 1 5A a nd 1 5B are flowcharts of an accessing process in the program nnode according to the present 
invention; 

Figures 16A and 168 are flowcharts of an accessing process in the DMA mode according to the present 
55 invention; and 

Figure 17 is a diagram for explaining a descriptor used in the DMA mode access according to the present 
invention. 
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Detailed Description of the Preferred Embodiment, 

Figures 1 A to 1 E illustrate the fundamentals of the present Invention. 

As shown in Figure 1 A, the subject of the present invention is a computer system comprising a plurality of 
5 processing modules (processor nDodules) 10 each having at least a nnain memory 20, a central processing unit 
18 and a connection unit 22 for connection to a system bus 16, and a plurality of shared storage modules 12 
each having at least a shared storage unit 26 and a connection unit 28 for connection to the system bus 16. 

As shown In Figure 1B, the present Invention is charactertzed. In that, In addition to a space 100 Inherent 
In the processing module which Is accessible by physical addresses of the central processing unit 18 of the 
10 processing module 10, a shared storage space 200 Is provided. This space Is likewise accessible by the physi- 
cal addresses of the central processing unit 18. 

The shared storage space 200 is divided into a plurality of partially shared storage spaces 300 and the 
rBlallonshIp with the shared storage modules 1 2 Is defined for each of the partially shared storage spaces 300. 
The shared storage modules 12, which have their relationships with the partially-shared storage spaces 
15 300 defined, store data which is to be shared among all the processing units 10, 

The main memory 20 is allocated to the processing module Inherent space 100 to thereby fonm multiple 
space for each of the processing nnodules 10. 

The main memory 20 which is allocated the processing module Inherent space 200, stores operands and 
the processing noodule's own data required by the central processing unit 18. 
20 The connection unit 22 of the processing unit 10 comprises program mode access control means 32 and 
DMA mode access control means 34 (shown in Figure 5). Program mode access control means 32 is for acces- 
sing an arbitrary shared storage module 1 2 allocated to the shared storage space 200 by the physical addresses 
of the central processing unit 18 and DMA mode access control means 34 is for translating the physical addres- 
ses of the central processing unit 18 to relative addresses for accessing an arbitrary shared storage module 
25 (12) allocated the shared storage space 200. 

When the central processing unit 18 accesses the shared storage space 200 by its physical address, the 
program mode access control means 32 of the connection unit 22 translates it to the unit ID of a shared storage 
module 12 which is a candidate for accessing and accesses the shared storage nrwdule 12 using the resulting 
unit ID as an identifier on the system bus 16. 
30 The program mode access control means 32 of the connection unit 22 produces a destination ID code (DID) 

identifying the shared storage nrwdule 12 which became a candidate for accessing, a source ID code (SID) rep- 
rasenting a source, an operand indicating the type of access, and a start transfer comnnand EC composed of 
access data capacity BCT. The program mode access control means 32 then fransmits the start transfer conrv 
mand EC to the system bus 16 together with an access address A of the destination shared storage nrK>dule 

55 12. 

More specifically, the program mode access control means 32 of the connection unit 22 transmits a start 
transfer command or start command SC and an access address A at the tin^ of fetch access, and a start transfer 
command SC, an access address A and data D to be written at the time of store access. 

At the tffne of the transmission from the processing module 10, the connection unit 28 of the shared storage 
40 module 12 monitors the system bus 16 and receives the start transfer command SC when Its unit ID matches 
the destination ID code In the start transfer command SC. 

Subsequently, the connection unit 28 of the shared storage module 12 responds to the reception of the 
start transfer command SC to produce an ID code DID Indicating the destination processing module 1 0, a source 
ID code SID indicating the source and a response transfer command or end command EC containing a con- 
45 elusion code at the temnination of access to the shared storage unit 26, and then transmrts them to the system 
bus 16. 

More specifically, the connection unit 28 of the shared storage module 12 transmits only the response trans- 
fer command EC at the time of memory access and the response transfer command EC and readout data at 
the lime of fetch access. 

so In response to the transmission of the response from the shared storage module 12, the connection unit 

22 of the processing unit 10 monitors the system bus 1 6 and receives the response transfer command EC when 
its unit ID matches the destination ID code In the response transfer command EC. 

Furthermore, the connection unit 22 of the processing module 10 Is equipped with a configuration control 
register 4 4 indicating packaging or unpackaging of the shared storage unit 12 corresponding to the partially 
55 shared storage space 300. 

Next, as shown in Figure 1 C, the present Invention is characterized, in that, in addition to the shared storage 
area accessible by the physical addresses of the processing module 10, there is provided extended shared 
storage space 400 which is accessible by relative addresses by the central processing unit 18. 
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The shared storage space 400 is divided into the shared storage units 12 each having a fixed memory 
capacity. 

The extended shared storage space 400 also contains the shared storage modules 12 which are allocated 
the shared storage space 200 accessible by the physical addresses of the central processing unit 18. 
5 Access to the shared storage modules 12 forming the extended shared storage space 400 is made by the 

DMA mode access control means 34 in the connection unit 22 of the processing unit 1 0. 

The DMA mode access control means 34 specifies a shared storage module 12 In the extended shared 
storage space 400 with a destination ID code DID In the start transfer command SC and specifies an address 
of the specified shared storage module 12 with an access address A. 
10 The central processing unit 18 of the processing module 10 allocates a fixed number of bits of address 

information to a selector for selecting from among the shared storage modules 12 and the remaining bits, to 
an internal address of a shared storage module 12 specified by the selector when the shared storage space 
200 is program-mode accessed. 

The present invention is not limited to the computer system of Figure 1 A and may be constructed from a 
is single processing module 10 and more than one shared storage unit 1 2 which is allocated shared storage space 
200 accessible by the physical addresses of the processing module 10. Also, more than one system bus may 
be provided. In this case, connection units corresponding in number to the system buses are provided in each 
of the processing modules 10 and shared storage modules 12. 

The shared storage configuration system of the present invention configured as described above provides 
20 the following effects. 

First, instruction codes and data are stored in separate locations, whereby the frequency of access to the 
shared storage module can be decreased. Therefore, the problem of limited system performance due to the 
high access frequency can be solved. 

The separation of instmctions and data is made by the physical addresses of the processing modules and 
25 the shared storage space is allocated to space which is common to all of them. However, the local main menrtory 
of each processing module is allocated space Inherent in its processing unit 

The instruction codes of the central processing unit in the processing module are stored in the main memory 
unit allocated the processing module's own space. Only data requiring to be shared among the processor mod- 
ules is stored in the shared storage nrwdules fonming the shared storage space. 
30 As a result, the frequency of access to the shared storage modules is considerably reduced, thus increasing 

the number of processor modules which can be built in the system and improving system performance. 

Moreover, since the memory area shared among more than one processing module Is reduced, the inde- 
pendence of each processor module is enhanced, thus permitting a fault-tolerant system to be built 

Furthemwe, by providing, In addition to the shared storage space serving as the physical address space 
55 of the centra! processing unit, the extended shared storage space which is accessible only by software DMA 
instructions, it becomes possible to build memory space which is much vaster than the physical address space. 

In the configuration of the above described computer system associated with the present invention, as 
shown in Figure ID. a shared storage space 200 capable of being accessed depending on the physical address 
of the process module 10 is divided by a plurality of partially-shared storage spaces 300, and the existence of 
40 a duplex configuration of shared storage modules 12 is defined for each part of the divided partially-shared 
storage space. Further, to make a duplex memory comprising a shared storage module 12, defined as having 
a duplex configuration, another shared storage module 12 having an inverted value at a specific bit in its unit 
ID can be specified. This module is thus generated as a conresponding module in a duplex memory. 

For example, to make a duplex memory comprising a shared storage module 12 defined as having a duplex 
45 conftguration, another shared storage module 1 2 having an inverted value at the least significant bit in its unit 
ID in contrast with the corresponding unit ID described above is specified as a conresponding module in a pair 
of duplex memory modules. 

In a duplex access, when a duplex conftguratton is determined according to a write instruction of the central 
processing unit 1 8 based on the software, the hardware of the connection unit 22 performs a first write into one 
50 shared storage modulo 12 having a specified unit ID, then a second write into the other shared storage module 
12 having an inverted value at the least significant bit in its unit ID in contrast with the specified unit ID. 

Additionally, the connectton unit 22 in the process module 10 is provided with a configuration definition regi- 
ster 44 for specifying the existence of a duplex configuration of the shared storage module 12. and then makes 
a duplicating write access refenring to the configuration definition register 44 when it receives a write instruction 
55 from the central processing unit 1 8. 

The configuration definition register 44 for specifying the existence of a duplex configuration makes a 
change during the operation according to the instruction of the central processing unit 18 based on the software. 
In the reading access, when the connection unit 22 in the process nr>odule 10 receives from the central 
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processing unit 1 8 an instruction to read a pair of shared storage modules 12 which are specified as having a 
duplex configuration, a reading acceas to one of the two shared storage modules 12 having a unit ID is issued 
by the read instruction of the central processing unit 18. 

In the transmission through the system tnis 16, as shown in Figure 1 E. the connection unit 22 in the process 

5 module 1 0 generates start transmit command (SC) comprising a destination ID code (DID) indicating a shared 
storage module 12 to be accessed, a source ID code (SID) indicating a source, an operand indicating the type 
of access, and the access data capacity (BCT). It then transmits the start transmit command (SC) to the above 
described system bus 16 with the access address (A) of the destination shared storage rrwdule 12. 

In turn, the connection unit 28 in the shared storage module 12 monitors the system bus 16 and perfonms 

10 an access according to the operand after accepting the start transmit command (SC) when It determines that 
the destination ID code of the start transmit command (SO) matches its own unit ID. 

The connection unit 22 in the process module 10 comprises the following hardware for perfonming a dup- 
licating write according to the specification of a duplex configuration: a program mode access controller 32 for 
accessing the shared storage module 12 according to the physical address of the central processing unit 18 

75 and a DMA mode access controller 34 for accessing the shared storage module 12 after converting the physical 
address of the central processing unit 1 8 to a relative address. 

However, if an abnormal condition is detected during the access to the shared storage module 12. a ter- 
mination code indicating the detailed information of the abnormal condition and a unit ID of the defective shared 
storage module 12 are announced to the software of the process module 10. 

20 Specifically, during a duplex access, a tennination code indicating the detailed infonnation of an abnomnal 

condition and only the least significant bit in the unit ID in the defective shared storage module 1 2 are announced 
to the software of the process module. 

That is, as each unit ID of a duplexed storage is assigned an even or odd number ID, announcing only the 
least significant bit is enough to detenmine the defective module in the pair. 

25 Further, when the software of the process module 12 is notified of the abnonmal temnination of the duplex 
access, a recovery process such as release of duplication, rewrite instruction, switch of the shared storage mod- 
ule 12 to be read, etc. is conducted by selecting the content of the configuration definition register 44 provided 
in the connection unit 22. 

The computer system shown in Figure 1Acan comprise a single process module 10 and a plurality of shared 
30 Storage units 12 provided with shared storage space accessible depending on the physical address of the pro- 
cess module 10. 

Further, a plurality of system buses 1 6 are provided to penmit a plurality of connection units 22 to be moun- 
ted in the process modules 10 and connection units 28 in the shared storage modules 12 depending on the 
number of system buses 16. 

35 The shared storage space comprises a plurality of shared storage modules, and the shared storage space 

is divided into a plurality of partially-shared storage space. According to the configuration definition for defining 
the relation between each of the divided partially-shared storage spaces and the shared storage modules, the 
existence of a duplex configuration and a shared storage area can be designated. 

Aduplex configuration can be defined optionally such that the addition/deletion of a shared storage module 
40 and the switch to a simplex/duplex configuration are permitted. 

The hardware-operated duplicating write can be easily conducted by limiting it to a pair of shared storage 
modules having an inverted value at one specific bit and equal values at ail the other bits in respective unit 
IDs. 

That is. in a writing access to a shared storage module where a duplex configuration is specified, a write 
4S instruction of the software causes the hardware to write into a shared storage module having a specified unit 
ID, and then to write into the other shared storage module in the duplex configuration with an inverted value 
applied to the specific bit in contrast with the first unit ID. Therefore, the process load on the software can be 
reduced without any other software process for the duplex access, thus greatly improving the system perform- 
ance. 

so Figure 2 ilustrates a system configuration of a multiprocessor system to which a shared storage configu- 
ration system according to the present invention is applied. 

The multiprocessor system comprises more than one processor module (PM) 10 and more than one shared 
storage module (SSM) 12. The processor modules 10 and the shared storage modules 12 are each connected 
to a shared system bus (SS-BUS) 16, a split bus, through a connection unit{SSBC-P) 22. The shared system 
55 bus 16 is controlled by a shared system bus handler (SSBH) 14 and the art)itration of the shared system bus 
16 is centrally controlled by the shared system bus handler 14. 

The no to U2 processor modules 10 have their unit ID numbers allocated as follows: 
PM#0; UID = 1000000 
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PM#1;UID = 1000001 
PM#2; UID = 1000010 
Also, the #0 to #2 shared storage modules 12 have their ID numbers allocated as follows: 
SSM#0; UID = 0000000 
5 SSM#1; UID = 0000001 

SSM#2; UID = 0000010 

Although the process modules 10 and the shared storage modules 12 are each controlled by the #0 and 
#1 shared system bus 16 which Is doubted for fault-tolerant purposes, they may be connected to more shared 
system buses 16. 

10 Figure 3 Is a block diagram of the processor module shown In Figure 2. 

The processor module comprises a central processing unit (^l P) 18. a local main memory unit (LSU) 20 
and two connection units (SSBC-P) 22 for the two shared system buses 16, which are all connected by an inter- 
nal bus 24. 

In the processor module 10, software (OS) rtjns on the central processing unit 18 and the main memory 
15 unit 20. Pieces of software from the processor modules 10 cooperate with one another to form a distributed 
OS for perfomiing a set of operations. The central processing unit 18 of each processor module fetches instruc- 
tion codes only from its main memory unit 20. 

Figure 4 is a block diagram of the shared storage module 12 shown in Figure 2. 
The shared storage module 1 2 comprises a shared storage unit (SSU) 24 and two connection units (SSBC- 
20 S) 28 corresponding to the two shared system buses 16, which are all connected by an internal bus 30. The 
shared storage unit 26 stores data to be shared among the processor modules 10 shown in Figure 2. 
Figure 5 is a block diagram of the connection unit 22 in the processor module 10 of Figure 3. 
The connection unit 22 accesses the shared storage unit 12 of Figure 2 via the shared system bus 16 in 
the following two modes: 
25 (1) program mode 

(2) DMA mode 

The connection unit 22 comprises a program mode access control circuit 32 and a DMA mode access control 
circuit 34, which are provided for the two access modes. It further comprises a transmitter-receiver circuit 36 
for transmitting data to or receiving data from the shared system bus 16 and a dual port RAM 38, which serves 
30 as a buffer. The program mode confrol circuit 32 comprises an address decoder 40, a timing controller 42. and 
a configuration definition register 44. The DMA mode access control circuit 34 comprises an address generator 
46, a timing controller 48 and a DMA control raglstar 50. 

Figure 6 is a block diagram of the connection unit (SSBC - S) 28 of the shared storage module 12 shown 
In Figure 4. 

55 The connectton unit 28 Is constructed from a DMA control circuit 52 an internal bus artiter circuit 54, a trans- 
mitter-receiver circuit 56, and a dual port RAM 58. The DMA control circuit comprised of an internal bus control 
circuit 74 for controlling the Internal bus 30, an address generator 70 and a timing controller 72; the Intemal 
bus arbitrator circuit 54 performs the arbitration of the Internal bus 30 when more than one connection unit 28 
is installed in the shared storage module 12, as shown in Figure 4; the transmitter-receiver circuit 56 is for the 
40 shared system bus 16; and the dual port RAM 58 serves as a buffer. 

The connection units 22 and 28, which make connections among the processor modules 10 and the shared 
storage modules 12 via the shared system bus 16. adopt a split transfer system in which each access is split 
into start transfer and response transfer. 

in the bus control of the split transfer system, a unit ID number is allocated to each module, the unit ID 
45 being used as a module identifier on the bus. 

Figure 7 illustrates examples of a start transfer command SC and a response transfer command EC used 
by the connection units 22 and 28. 

In the start transfer command SC of Figure 7. the DID (Destination ID) indicates the unit ID of a destination 
module and the SID (Source ID) indicates the unit ID of a source module. The operand indicates a type of 
so access. The types of access include memoiy access to the shared storage nrxxiules 12, access to the shared 
storage units 12 and the other processor modules 10 to halt them and access to the control register to reset 
it. The BCT (Byte Count) indicates data capacity in accessing the shared storage modules 12. 

In the response transfer command EC. the DID and SID are the same as those in the start transfer command 
SC and the conclusion code indicates a conclusion state of the destination, i.e., normal conclusion or abnormal 
55 conclusion. 

Figure 8 is a diagram for explaining the operatwn of write access (store access) for transferring data from 
a source processor module 10 to a shared storage module 12 over the shared system bus 16 and writing it in 
the memory nrwdute 12. 
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First, the source (accessing) processor module 1 0 prepares a start transfer command SC. That is, the start 
transfer comnand SC prepared by the source processor module consists of the SID indicating its own unit ID. 
the DID indicating the unit ID of a shared storage module 12 being accessed, an operand indicating the write 
access and the BCT indicating the access capacity. Following the start transfer command SC. an access 
5 address A of the destination shared storage module 12 and data D to t>e written into are sent onto the system 
bus 16. 

The destination shared storage module 12 monitors the shared system bus 16 and compares the DID lnd^ 
eating the destination contained in the start transfer command SC with its own unit ID. When a coincidence 
occurs, the shared storage module 12 performs a receiving operation. The shared storage module then maizes 
10 a write access to the shared storage unit 26 (refer to Figure 4) and transmits to the source processor module 
a response transfer command EC containing the conclusion code of the write access and in which the DID and 
SID are interchanged because the start transfer and the response transfer are opposite to each other in the 
direction of transfer. 

The source processor nwdule 10 monitors the shared system bus 16 and perfonms the receiving operation 
15 when a coincidence occurs between the destination ID in the response transfer command EC and its own unit 
ID, thereby terminating one-time access. 

During the idle time from the tennlnation of transmission of the start transfer command SC to the initiation 
of the transmission of the response transfer command EC, the system bus may be used to transfer the start 
transfer command SC or the response transfer command EC for another access. 
20 Figure 9 is a diagram for use explaining the operation of read access (fetch access) for reading data from 

a shared storage rrwdule 12 and transferring it to a processor module 10. 

First, a source processor module 10 prepares a start transfer command SC which consists of the SID indi- 
cating its own unit ID, the DID indicating the unit ID of a destination shared storage module 12 being accessed, 
an operand indicating the read access and the BCT indicating the access capacity. Following the start transfer 
25 command or start command SC, an access address A of the shared storage module 12 being accessed is sent 
onto the system bus 16. 

The destination shared storage module 12 monitors the shared system bus 16 and compares the DID in 
the start transfer command SC with its own unit ID. When the comparison indicates equality, the nrKxiule 12 
performs the receiving operation. The desUnation shared storage module 12 then mal<es read access to the 
30 Shared storage unit 26 (refer to Figure 4) of the shared storage nrwdule 12 and transmits to the source processor 
module 10 a response transfer command or end command EC. which contains the conclusion code of the read 
access. Furthennnore. in the response transfer command EC, the DID and SID are Interchanged because the 
start transfer and the response transfer are opposite to each other in the direction of transfer, and readout data 
D. 

35 The source processor module 10 monitors the shared system bus 16 and perfomns the receiving operation 

when a coincidence occurs between the destination ID in the response transfer command EC and in its own 
unit ID. thereby tenmlnating one-time read access. 

The read access is made In the program access mode or the DMA access mode. In either access nrvxle, 
the operations on the system bus 16 are the same. 

40 Figure 1 0 is a diagram for explaining an address space map in the present embodiment of the present inven- 

tion. 

In Figure 10, the physical address space of each processor module is roughly classified into shared storage 
module space (hereinafter refenred to as SSU space) and space inherent in the processor module (hereinafter 
referred to as PM inherent space). 
45 The PM inherent space is space which is inherent in hardware resources of each processor module 10 

and presents in each processor module 10. The PM inherent space forms multiple-address space for the total 
number of processor modules in the system. In the present embodiment, it is supposed that the amount of PM 
inherent space is 2GB. 

The SSU space is common to ail the processor modules 10. That is. the SSU space is fonmed by more 
50 than one shared storage module 12 and forms space which is comnrx5n to the processor modules 10 in the sys- 
tem; it can also be directly accessed by the physical addresses of the processor modules 10. Thus, only data 
to be shared among all the processor modules 10 is stored in the SSU space. 

In the present embodiment, the 2-GB SSU space is used as an example. As shown on the left side of the 
figure, the SSU space is hirther divided into eight partial SSU spaces #0 to #7 in a 256-MB unit. Each of the 
55 partial SSU spaces #0 to #7 is formed from one of the shared storage modules 12 of the present Invention. 

Moreover, the PM space of each processor module 10 is divided into LSU space and control space. 
Operands required by each processor nrwdule and its own data are stored in the LSU space, which is a part 
of the PM inherent space. It is the presence of the LSU space that permits the number of accesses made by 
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each processor module to the SSU space (formed by the shared storage modules 12 to be decreased). 

If an access address designated by the central processing unit 18 of each processor module points to the 
LSU space, then dosed access will be made within the processor nr>odu!e 10. 

When the access address (physical address) designated by the central processing unit 18 points to the 
5 SSU space, the connection unit 22 of the processor module 10 recognizes that the access is being made to 
the SSU space and accesses a corresponding shared storage module 12 via the system bus 16. 

By mapping the SSU space and the LSU space Into the physical address space on the processor modules 
10, It becomes possible for software to access the SSU space and the LSU space without needing to switch 
between the SSU space and the SSU space. 
10 Since the SSU space Is directly mapped Into the physical address space of each processor module as 

shown in Figure 10, access to the SSU space formed of more than one shared storage module 12 may be made 
in the following two access modes. 

(1) Program mode in which physical addresses are used to make direct access by software Instructions 

of the central processing unit IB; or 
13 (2) DMA mode in which a shared storage module to be accessed is selected and a data transfer between 

a processor module 1 0 and the shared storage module 1 2 is started by specifying an access address and 

the length of transfer. 

The accessible SSU space varies with the access mode. In the present embodiment, the SSU space 
accessible by the program mode is only the 2-GB space which has been directly mapped into the physical 
20 address space of each processor module. In the DMA mode, however, by designating a shared storage module 
12 to be accessed using its unit ID. it becomes possible to access much vaster SSU space, i.e., extended SSU 
space. 

In the DMA mode access, the unit ID of a shared storage module 10 to be accessed is designated by the 
DID in the start transfer command SC shown in Figures 8 and 9 and the shared storage module is addressed 
25 by the following address A. Therefore, theoretically, it becomes possible to access extended SSU space having 
a capacity of 2" (n is an address bit width of central processing unit 1 8 plus a bit width of the unit ID). That is. 
the extended SSU space forms multiple spaces which are distinguished by the unit ID numbers serving as iden- 
tifiers. 

Figure 11 is a diagram for explaining the SSU space which has been mapped into the physical address 
30 space of the processor module 1 0 and the extended SSU space which is accessible only in the DMA mode. 

In Figure 1 1 , the number of bits of each of the unit ID numbers of the shared storage modules 12 constituting 
the extended SSU space is seven, and 64 unit ID numbers, 0000000 to 01111 1 1, are assigned to the shared 
storage modules 12. 

Here, eight unit ID numbers, 0000000 to 00001 1 1. which are accessible In the program mode and the DMA 
35 mode are assigned to the 2-GB physical address space to be used for configuration definitions of the shared 
storage modules 12 constituting double-shared storage (described later). The remaining 56 unit ID numbers 
corresponding to 56 SSU modules used In DMA mode are each assigned 4 GB. As a result, the extended SSU 
space of 226 GB In total can be accessed In the DMA mode. 

Of course, the number of unit ID numbers is not limited to eight as shown in Figure 1 1 , and 1 6 shared stor- 
40 age modules 000000 to 0001 111, may be used to fully form double-shared storage space (non-extended 2-GB 
space). 

Moreover, by increasing the number of bits of the unit ID or the rate of assignment of the unit ID numbers 
to the shared storage nrKKlules 1 2, it is possible to extend the extended SSU space with the DMA mode access. 

Although the SSU space of the present invention, which is accessible by the physical addresses, is fonmed 
45 by more than one shared storage module 1 2. all the memory devices for the SSU space need not be packaged; 
unpackaged areas may also exist. In addition, all or part of the SSU space may be double-configured for fault- 
tolerance. 

The unpackaged areas and the double configuration, as shown in the SSU space of the processor modules 
1 0 of Figure 10, can be realized by dividing the SSU space of the processor modules 10 into partial SSU spaces 
so and defining relattonship with the shared storage modules 12 for each of the partial SSU spaces, that is, rela- 
tionship with the shared storage modules 12 having the unit ID numbers 0000000 to 00001 1 1 forming the exten- 
ded SSU space shown in Figure 11. 

In the embodiment of Figure 10, the 2-GB SSU space is divided into 8 spaces each of 256 MB and the 
configuration definitions indicating the conrespondence relationship of each of the partial SSU spaces #0 to #7 
55 to the shared storage nrwdules 12 are given. 

The configuration definitions of the shared storage modules 12 are realized by operating the configuration 
definition register 44 (refer to Figure 5) built in each processor module. The configuration register 44 is con- 
structed from a first control register 60 shown in Figure 12 and second control registers 62-1 and 62-2 shown 
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in Figure 13. 

The first control register 60 of Figure 12 specifies the presence or absence of the shared storage modules 
1 2 corresponding to the SSU space divided into 8 spaces each of 256 MB as shown in Figure 10, in other words, 
whether the shared storage nnodules 12 are packaged or unpackaged. In this embodament, Figure 12 indicates 
that five partiai SSU spaces #0, <^1 , #2, #4, #7 con-esponding to 10, II , i2, 14, 17 each indicated by a high bit (1) 
have been packaged and three partial SSU spaces #3, #5. #6 con-esponding to 13, 15, 16 each indicated by a 
low bit (0) have not been packaged. 

The second control registers 62-1 and 62-2 shown in Figure 13 specify which of the shared storage modules 
12 correspond to the partial SSU spaces indicated by high bits in the first control register 60 and have thus 
been packaged, the single or double configuration and the access sequence when the double configuration Is 
specified. 

In this embodiment, only bits DO, D1, D2, D4. and D7 corresponding to the partial SSU spaces #0, #1, #2, 
#4 and #7 are valid and specify the configurations of corresponding shared storage modules 12 and access 
forms. That is, bits DO, 01 and D7 are Os, indicating that the partial SSU spaces #0, #1 and #7 are of single 
configuration. When partial SSU spaces #0, #1 and #7arB accessed, the shared storage modules 12 identified 
by the unit ID = 0, 1, 7 are accessed. 

On the other hand, bits D2 and D4 are Is. defining the double configuration. When the partial SSU spaces 
U2 and #4 of double configuration are accessed, data is read from the shared storage nK>dules identified by 
the unit ID2 and the unit ID4. 

The shared storage modules of double configuration are written into as follows. In the first writing, a shared 
storage module 12 identified by the unit ID in the second control register 62-1 and 62-2 is written into and, in 
the second writing, another shared storage module 12 is written into which has the unit ID in which a specific 
bit in the first unit ID, for example, the least significant bit is inverted. 

A pair of duplex shared storage modules 1 2. which can be specified by the second control register to take 
the double configuration, has unit ID numbers v/hich are equal except for their least significant bits, e.g. 00001 00 
and 0000101. 

In the embodiment of Figure 13, two partial SSU spaces #2 and #4 are specified by bits D2 and D4 = 1 to 
take double configuration. For the partial SSU space #2, the following pair is set. 



Partial SSU space Unit ID 

§2 0000010 

#3 0000011 

For the partial SSU space #4, the following pair Is set. 

Partial SSU space Unit ID 

#4 ' 0000100 

#5 0000101 



Figure 14 is a diagram for explaining the packaged state and configuration definittens of the shared storage 
rnodules 12 which are based on the specificattons by the second control registers of Figures 12 and 13. 

Eight shared storage modules 12 are provided to correspond to the SSU spaces #0 to #7 of the processor 
modules 10, but the shared storage module corresponding to the SSU space #6 is not packaged. Since the 
SSU spaces #3 and #5 are doubled with the shared storage modules of the SSU spaces #2 and #4, respectively, 
no shared storage modules 12 corresponding to the SSU spaces #3 and #5 exist. The remaining SSU spaces 
#0, #1 and #7 have a one-to-one correspondence with the shared storage nwdules 12 because of their single 
confjguration, 

By dividing the SSU space which can be accessed by the physical addresses of the processor modules 
1 0 and giving configuration definitions thereof as described above, it becomes possible to specify validity/Invali- 
dity or single/double configuration of the shared storage modules for each of the divided SSU space units even 
when the system Is implemented. 

In this embodiment, in the program mode in which the SSU spaces are directiy accessed by the physical 
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addresses based on the central processing unit software instructions, four bits bO to b3 in the 32- bit SSU space 
address serve as a selector for the shared storage modules 12 and the renDaining 28 bits b4 to b31 serve as 
an address of the shared storags units 12. 

Where the mennory capacity built in the shared storage nrtodules 12 exceeds 256 MB, the meaning of the 

5 selector for selecting from among the shared storage modules 12 remains unchanged, but the internal addres- 
ses of the shared storage nwdules 12 are made to correspond to the memory capacity built into the shared 
storage modules 12. When, for example, the memory capacity Is 512 MB, I.e. double 256 MB. 29 bits b3 to 
b31 of address Information are used to designate Internal addresses of the shared storage modules 12. When 
the memory capacity is 1 GB, 30 bits b2 to b31 are used to designate internal addresses of the shared storage 

10 modules 12. Moreover, when the memory capacity Is extended up to 2GB. 31 bits are all used to designate 
internal addresses of the shared storage modules. Where the memory capadty of the shared storage modules 
12 exceeds 256,MB, the number of bits of the selector for selecting from among the shared storage modules 
decreases as described above. Thus, the same unit ID will be specified for the partial SSU spaces divided into 
256-MB units. 

15 In the present invention, access in the program mode is made in accordance with flowcharts shown in Fig- 

ures 15A and 15B. 

In Figure 15A. sofhrtfare accesses the SSU space as an instruction of the central processing unit in step 
SI. In step S2, the connection unit 22 decides which of the shared storage units 12 has the addressed SSU 
space on the basis of four address bits bO to b3 from the'central processing unit 18 and the contents of the 
20 second control registers 62-1 and 62-2 for giving configuration definitions of the shared storage modules 12. 
Moreover, a decision is made in step S3 as to whether or not the shared storage module 12 specified by the 
contents of the first control register 60 has been packaged. If it has not, the operation will be tenminated abnor- 
mally in step S4. 

When it is decided in step S3 that the shared storage module 12 specified by the second control registers 
25 is packaged, the connection unit 22, in step S5, retums a retry signal to the cenb-al processing unit 18, so that 
the central processing unit 16 is placed in the wait state. 

In step S6, a decision is made as to whether an instruction from the central processing unit 18 is a fetch 
instruction to read data from the shared storage module 12 or a store instruction to write data into the shared 
storage module 12. 

30 If the instruction from the central processing unit 18 is a fetch instruction, a start transfer command SC is 

prepared in stop S7 from the contents of the second control registers 62-1 and 62-2 with the unit ID of the des- 
tinatton shared storage module used as the DID. After the bus right for the shared system bus 16 has been 
acquired in step S8, the start transfer command SC and address A are transmitted to the shared system bus 
16. 

35 If, on the other hand, It Is decided In step S3 that the Instruction Is a store Instruction, a start transfer conn- 

mand SC is likewise prepared in step S14 from the contents of the second control registers 62-1 and 62-2 with 
the unit ID of the destinatton shared storage module used as the DID. In step S14, the start transfer command 
SC. address A and data D to be written Into are sent onto the shared system bus 16 after acqulsitfon of the 
bus right for the shared system bus 16. 

40 In the shared storage module 1 2. on the other hand, as shown in the flowchart of Figure 1 5B. the connection 

unit 28 monitors the shared system bus 16 in step SI and compares its unit ID the DID in the start transfer 
command in step S2. When the comparison indicates equality, receive data is written into the built-in dual port 
RAM 56 in step S3. 

In step S4, it is determined whether the instruction is a fetch instruction or a store instruction. 
45 If it is a fetch instruction, the connection unit 28 penmits data transfer between the dual port RAM 56 and 

the shared storage unit 26 under the control of the internal bus control circuit 64 in step S5 after acquisition of 
the bus right for the internal bus 30. In stepSS, the connection unit 28 responds to the source processor module 
1 0 at the teimination of data transfer within the shared storage module 12. 

That is, a response transfer command EC containing a conclusion code is prepared in step S6, bus right 
50 for the shared system bus 16 is acquired in step S7, and then the response transfer command EC and readout 
data D are sent onto the shared system bus 16 in step S8. 

If in step S4 the instruction Is determined to be a store instruction, the connection unit 28 pennits data trans- 
fer between the dual port RAM 56 and the shared storage unit 26 in step S9 under the control of the internal 
bus conb-ol circuit 64 after acq uisrtion of the bus right for the intemal bus 30. The connection unit 28 responds 
55 to the source processor module 10 at the tenminatton of the data transfer (the writing of data) within the shared 
storage module 12. 

That is, a response transfer command EC containing a conclusion code is prepared in step SIC, the bus 
right for the shared system bus 16 is acquired in step S1 1 and then the response transfer command EC is sent 
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onto the shared system bus 16 in step S12. 

Returning to the flowchart of Figure 15A for the processor modules, the connection unit 22 rrwnitors the 
shared system bus 16 as indicated in step S9 or SI 6 and compares its own unit ID with the DID in the response 
transfer command EC In step S10 or S17. When the comparison indicates equality In step S10 or S17, the res- 
ponse transfer command EC and data D are received in step S11 fora fetch instruction or the response transfer 
command EC is received in step SI 8 for a store instruction. 

In subsequent step S12 or S20, a retry signal Issued to the central processing unit 18 Is withdrawn, so that 
the wait state of the central processing unit 18 Is canceled. For a fetch Instruction, a conclusion signal of the 
internal bus 24 is returned to the central processing unit 18 together with received data D in step SI 3. Fora 
store instruction, a conclusion signal DC of the internal bus 24 Is returned to the central processing unit 18 in 
step 20. 

The access in the program mode is thus terminated. 

The double writing process in steps S19 and S22 to S28 of Figures 15A will be darified later. 
Next, reference is made to the flowcharts of Figures 16A and 16B to describe access in the DMA mode of 
the present invention. 

For access in the DMA mode, in step SI, the cental processing unit 18 frst places on the main memory 
20 of the processor module 10 a desaiptor containing conb-ol contents, such as the unit ID of a destination 
shared storage module 12, an access address, the b-ansfer length, etc., shown in Figure 17. 

That is. in the descriptor of Figure 17. the BCT indicates the number of transfer bytes, the buffer address 
BUFA indicates the start physical address of the data buffer placed on the main memory 20. and the DID indi- 
cates the unit ID of a shared storage module which is a candidate for access. Moreover, the SSUA indicates 
a relative address (an internal address within the shared storage nwdule 12 specified by the DID) within the 
shared storage module 12 to be accessed, which differs from the physical address of the SSU space in the 
program mode. 

After placement of the descriptor in step S1 , the direction of transfer, double writing into the shared storage 
modules 12 and the address of the descriptor on the main memory 20 are set in the DMA control register 50 
of the DMA control circuit 34 in the connection unit 22 in step S2, thereby starting DMA mode access, 

When the DMA mode access is started in step S2. the connection unit 22 acquires the bus right for the 
intemal bus 24 of the processor module 10. Thus, the connection unit 22 is permitted to direcOy access the 
main memory 20 under the control of the DMA control circuit 34 to thereby read the descriptor from the main 
memory 20 and permit data b-ansferfirom the main memory 20 to the dual port RAM 38 in the connection unit. 

After termination of data transfer to the dual port RAM 38 in the connection unit 22. the direction of data 
transfer is checked in step S4. If the readout data transfer direction is from the shared storage module 1 2 to 
the main memory 20 (hereinafter referred to as (SSU LSU) direction), a start transfer command SC containing 
the unit ID of the shared storage module 12 and the length of transfer as shown in Figure 7 is prepared by the 
transmitter-receiver circuit 36 in step S5. On the other hand, if the write data transfer direction is from the main 
memory 20 to the shared storage nrwdule 12 (hereinafter referred to as (LSU SSU) direction), the transfer 
start command SC Is likewise prepared by the transmitter-receiver circuit 36 In step SI 3. 

Subsequently, the transmitter-receiver circuit 36 acquires the bus right for the shared system bus 16 in 
steps Se and S14. 

If the transfer is in the (SSU LSU) direction, the operation proceeds from step S6 to step S7, so that the 
start transfer command SC and the address A are sent onto the shared system bus 16. if the transfer is in the 
(LSU SSU) direction, the operation proceeds from step SI 5 to step SI 6. so that the start transfer command 
SC. address A and data D are transmitted to the shared system bus 16. 

On the other hand, the connection unit 28 of the shared storage module 12 monitors the shared system 
bus 1 6 in step SI of Figure 16B and compares its unit ID with the DID in the start transfer command DC in step 
S2. When the comparison indicates equality, the connection unit writes received data into the dual port RAM 
56 in step S3. 

Next, the transfer direction is checked in step 84. When the transfer is in the (LSU SSU) direction, the 
operation proceeds to step S5. When the transfer is in the (SSU LSU) direction, the operation proceeds to 
step S9. In step S5 or S9, the intemal bus control circuit 64 of the DMA control circurt 52 in the connection unit 
28 acquires the bus right for the intemal bus 30, so that data transfer is permitted between the dual port RAM 
56 and the shared storage unit 26. In this case, data is read from the shared storage unit 26 in step S5, while 
data is written into the shared storage unit 26 in step S9. 

When access in the DMA mode is terminated in step S6 or S9, the response transfer command EC con- 
taining the conclusion corrvnand shown in Figure 7 is prepared in step S6 orSIO and the bus right for the shared 
system bus 1 6 is acquired in step S7 or S11. Then, the operation proceeds to step S8 or S12. That is, in step 
S8 in which (LSU SSU). readout data D is added to the response transfer command EC and then transmitted 
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10 the shared system bus 16. In step S12 in which (SSU - LSU), the response transfer command EC is trans- 
mitted to the shared system bus. 

Returning now to the flowchart of Figure 16Aforthe processor modules 10, the connection unit 22 of the 
processor module 10 monitors the shared system bus 16 as in step S8 or S17. When equality is found between 
5 its unit I D and the DID in the response transfer command , the operation proceeds to step SI 0 or S1 9 for a receiv- 
ing operation. The received data is stored in the dual port RAM 38 in the connection unit 22. 

Subsequently, for transfer in the (SSU LSU) direction, the bus right for the Internal bus 24 is acquired 
In step S1 1 , so that data D received by the dual port RAM 38 Is transferred to the main memory 20 under the 
DMA control. Finally, the conclusion code is set in the DMA control register 50 in step 812 and the completion 
10 Is notified to the central processing unit 18 as an Interruption signal. 

For transfer in the (LSU -> SSU) direction, the operation proceeds to step S21 via step S20, whereby the 
conclusion code is set in the DMA control register 50 and the completion is notified to the control processing 
unit 18 as an interruption signal. 

One-time access in the DMA mode is thus temninated. 
15 The double writing process in steps 820 and 822 to 827 will be clarified later. 

The shared storage modules 12 constituting the SSU space of the present invention can be doubled for 
fault-tolerance. When doubled shared storage modules 12 are accessed, the writing operation is performed on 
both of the doubled shared storage modules, while the reading operation is perfomied on one of the shared 
storage modules 12. 

20 The write access to the doubled shared storage nwdules 12 is carried out by hardware control of the con- 
nection unit 22 in response to an access instruction from the central processing unit 18 based on software. 
The write access to the doubled shared storage modules is not made simultaneously for reasons of hardware 
control. That is, the writing operation is first perfomied on one of the shared storage modules and, when the 
first writing operation is completed, the other is written into. The specific accessing methods vary between the 

25 program mode and the DMA mode. 

The double accessing method in the program mode is perfomned in accordance with the process in steps 
SI 9 and S22 to S28 shown in Figure ISA. 

That is, the first store access is processed in the sanrte manner as in the single configuration. When, in 
step SI 8, a response transfer command EC indicating nonnal tenmlnation is received at the temiination of the 

30 first write access to the shared storage module 12, a reference is made in step S19 to the second control regi- 
sters 62-1 and 62-2. 

Into the second control registers 62-1 and 62-2 are entered a bit for specifying the double configuration of 

shared storage modules, the unit ID of a shared storage module to be read from and the unit ID of a shared 

storage module to be written Into first. 
35 When a reference Is made to the second control registers 62-1 and 62-2, If the shared storage nrtodule to 

be accessed is defined as single configuration, then the connection unit 22 makes the first write access to the 

shared storage module to be accessed in step S20. 

When the double configuration Is defined, in step S22, a transfer start command SC for store Is prepared 

in the DID of which is equal to the unit ID of the shared storage module, which is specified first in the second 
40 control registers and has already been subjected to access, except the least significant bit. In subsequent step 

S23, the bus right for the shared system bus 16 is acquired to transmit the start transfer command SC, address 

A and data D which is the same as that in the first access and accesses the other of the double-configured 

shared storage modules. 

In the second access, with the first access, the process indicated in steps 81 to 84 and 89 to 812 of Figure 
45 ISA is performed by the shared storage modules and, finally, a response transfer comnnand EC containing a 
conclusion code is transmitted to the shared system bus. 

Data transferred from the shared storage module is monitored in step S24 of Figure 1 5A and, when equality 
is found between its own unit ID and the DID in step S25, the response transfer command EC is received in 
step S26. Thereby, as in steps S12 and SI 3, a set of store accesses to the double- configured shared storage 
50 modules is terminated. 

By setting configuration definitions of the shared storage nrtodules in the second control registers as des- 
cribed above, when the central processing unit 18 makes progranvmode access (access to the SSU space) 
to a physical address of a shared storage module on the basis of software, the processor site connection unit 
22 checks whether the shared storage unit is of single configuration or double configuration and is able to auto- 
55 matically change the unit ID to make the second access at the termination of the first access if it is of double 
configuration. 

Even if a shared storage module specified in the second control registers 62-1 and 62-2 is defined as double 
configuration, one of the doubled shared storage modules may be disabled against access because of a fault 
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therein. A situation in which a compressed operation has to be temporarily employed can be coped with by 
changing the operation mode of the second control registers from the double configuration mode to the single 
configuration mode when the abnormal conclusion code is found in the response transfer command EC 
obtained at the tenmination of access. 
5 When, at the time of double-mode access, access to shared storage modules is terminated abnormally, it 

is possible to check the presence or absence of equality of the contents of two doubled shared storage modules 
as well as the access sequence based on the unit ID of the abnormal shared storage module and the contents 
of the second control registers 62-1 and 62-2. In the program mode In particular, since the success or failure 
in access can be basically recognized on a word-by-word basis, even if data equality is lost between the dou- 
10 ble-configured shared storage modules, the recovery process has only to be performed taking into account 
unequal words and the shared storage module which has failed to be accessed. 

Next, the DMA-mode double accessing method is illustrated in steps S20, S22 to S27 of Figure 16A. 
That is. the Trsl DMA access in which data transfer is in the (LSU - SSU) direction is processed in the same 
manner as in the single configuration. After a response transfer command EC indicating nomial tenmination of 
73 the frst access to the shared storage rrwdule is received in step S 19, the presence or absence of the definition 
of double writing is cherked in step S20. 

Although the DMA-mode access is started by selecting an object shared storage module and specifying 
an access address of the shared storage module and the length of transfer, the direction of transfer and 
single/double configuration are specified in the DMA control register 50 of the connectfon unit 22. 
20 For this reason, in step S20. reference is made to the DMA control register 50 defining the configuration 

of the shared storage module to check the presence or absence of the definition of double writing. 

As a result of the reference to the DMA control register 50. if the shared storage module to be accessed 
is defined as single configuration, the process advances to step 21 and the connection unit 22 terminates 
access to the shared storage unit with only one write access. 
25 However, if the double configuration is defined, a transfer start command SC for writing is prepared in step 
S22 and has the same DID as the unit ID of the shared storage module, which is first designated in the DMA 
control register 50 and has already been accessed, except the least significant bit. In subsequent step S23, 
the bus right for the shared system bus is acquired to transmit the start transfer command SC, address A and 
data D which is the same as that in the first access to the shared system bus 16, and makes DMA write access 
30 to the other of the double-configured memory modules. 

In the second DMA access, as with the first, the process in steps SI to S4 and S9 to 812 shown in Figure 
16B are perfonmed by the shared storage modules and finally a response transfer command EC containing a 
conclusion code is transmitted to the shared system bus 16. 

That Is, data transfen-ed from the shared storage module is monitored In step S24 of Figure 1 6A and, when 
3S an equality Is found between Its own unit ID and the DID In step S25, the response transfer command EC Is 
received in step 826. As in steps 811 and 812. DMA access writing into the doubled shared storage modules 
is terminated In steps 826 and 827. 

As with the double writing In the program mode, In the DMA mode as well, If the mode of operation Is speci- 
fied, the double writing is automatically performed by the hardware. 
40 Where abnormal terminatfon occurs during DMA access to the doubled shared storage modules, it Is poss- 

ible to check data equality between two doubled shared storage modules as weW as the access sequence based 
on the unit ID being accessed and the least significant bit of the unit ID of the shared storage module specified 
at the time of the first access. 

Although more than one processor module is indicated in the embodiment of Figure 2. the system may 
45 comprise a single processor module. 

As described above, according to the present invention, the instruction is separated from the data, thereby 
decreasing the frequency of access to a shared storage module and increasing the number of processor mod- 
ules to be equipped with the system. As a result, the present inventten can greatly improve system perfonmance. 
As the menrwry area or space co-owned by a plurality of processor modules is decreased, the independ- 
so ence of each processor is increased and thus a more reliable fault-tolerant computer can be configured. 

Further, an expanded shared storage space which is accessible by DMA instruction using software is pro- 
vided and thus a computer system v^th a vast menrwry space can be configured. 

A duplex configuratton can be changed during system operation, thus realizing fault tolerant capabilities 
depending on the necessary memory volume where duplication is required for shared storage space. 
55 As the hardware twice performs automatic duplicating writes according to the write instruction ft-om the 
software, the process load of the software can be reduced without any other software process, thus greatly 
improving system perfonmance, 
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Claims 

1 . A shared storage configuration system for use in a computer system comprising: 

a plurality of processing modules each having at least a main memory unit, a central processing 
unit and a connection unit for connection to a system bus, each of said processing modules having inherent 
space which is accessible by physical addresses of said central processing unit of each of said processing 
modules, and a plurality of shared storage modules each having a shared storage unit and a connection 
unit for connection to sakJ system bus each of said shared storage nrKXlules having shared storage space 
which is accessible by the physical addresses of said central processing unit of each of said processing 
rTKxJutes. 

2. A shared storage configuration system according to daim 1, in which said shared storage space is divided 
into a plurality of partial shared storage spaces and the relationship of each of said partial shared storage 
spaces to said shared storage OKtdules is defined. 

3. A shared storage configuration system according to claim 2, in which data to be shared among said pro- 
cessing modules is stored in said shared storage nx}dules. 

4. A shared storage configuration system according to claim 1, In which said main memory unit is allocated 
to said processing module inherent space to form independent space for each of said processing modules. 

5. A shared storage configuration system according to daim 4, in which said main memory unit allocated 
said processing module inherent space stores operands required by said central processing unit and said 
processing nrxxlule's own data. 

6. A shared storage configuration system according to claim 2, in which said connection unit of said proces- 
sing nrKKlule comprises: 

program mode access control means for accessing an arbitrary shared storage module allocated 
said shared storage space by physical addresses of said central processing unit; and 

DMA mode access control means for accessing an art)itrary shared storage module allocated said 
shared storage space by banslating physical addresses of said central processing unit to relative addres- 
ses. 

7. A shared storage configuration system according to claim 6. in which said program mode access control 
means, when said central processing unit accessed said shared storage space using its physical address, 
b-anslates the physical address to the unit ID of a shared storage module to be accessed and accesses 
said shared storage module with said unit ID used as an Identifier on said system bus. 

8. A shared storage configuration system according to daim 2, in which said program mode access control 
means of said connection unit prepares a start transfer command formed of a destination ID code indicating 
the shared storage module to be accessed, a source ID code indicating a source, an operand indicating 
the type of access and access data capacity and transmits it to said system bus together with an access 
address of the destination shared storage module. 

9. A shared storage configuratbn system according to daim 8, in which said program mode access control 
means of said connection unit transmits said start transfer command and said access address at the time 
of fetch access and transmits said start transfer command, said access address and data to be written at 
the time of store access. 

10. A shared storage configuration system according to daim 8, in which said connection unit of said shared 
storage module monitors said access bus and operates to receive said start transfer command when an 
equality is found between the destination ID code in said start transfer command and its own unit ID. 

11. A shared storage configuration system according to daim 10, in which said connection unit of said shared 
storage module prepares a response transfer command formed of an ID code indicating a destination pro- 
cessing module, a source ID code indicating a source and a condusion code and then transmits it to said 
system bus when access to said shared storage unit Is tenminated on the basis of said start transfer conrh 
mand which has been received. 
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-12. A shared storage configuration system according to daim 11 , in which said connection unit of said shared 
storage module transmits only said response transfer command containing a conclusion mode at the time 
of store access and transmits said response transfer command and readout data at the time of fetch 



access. 



10 



13. A shared storage configuration system according to daim 1 1Jn which said connection unit of said pro- 
cessing module monitors said system bus and operates to receive said response transfer command when 
an equality is found between a destination ID code in said response transfer command and its own unit 
ID. 

14. A shared storage configuration system according to claim 3, in which said connection unit of said proces- 
sing module indudes a configuration control register indicating packaging or unpackaging of a shared stor- 
age unit corresponding to said partial shared storage spaces. 

15 1 5. A shared storage configuration system according to claim 1 , further comprising an extended shared stor- 
age space which is accessible by relative addresses of said cental processing unit 

16. A shared storage configuration system according to daim 15, in which said extended shared storage space 
is fonmed of a plurality of shared storage modules each having a fixed memory capacity. 

20 

1 7. A shared storage configuration system according to daim 1 5, in which said extended shared storage space 
contains a plurality of shared storage units allocated shared storage space which is accessible by physical 
addresses of said central processing unK. 

25 18. A shared storage configuration system according to daim 15, in which access to said shared storage mod- 
ules forming said extended shared storage space is made by said DMA mode access control means of 
said connection unit in said processing module. 

19. A shared storage configuration system according to daim 18. In whteh said DMA roode access control 
30 means spedfies one of said shared storage modules fonming said extended shared storage space in 

accordance with the destination ID code in the start transfer command and an address of the specified 
shared storage module In accordance with an access address. 

20. Ashared storage configuration system according to daim 16. in which, at the time of access to said exten- 
3$ ded shared storage space, said central processing unit of said processing nrKKJule allocates a fixed number 

of bits in address infonmation to a selector of said shared storage modules and the remaining bits to an 
internal address of a shared storage module specified by said selector. 

21. A shared storage configuration system according to daim 1 , in which said computer system is constructed 
40 from a sinde processing module arid a plurality of shared storage modules allocated shared storage space 

which is accessible by physical addresses of said single processing module. 

22. A shared storage configuration system according to daim 1 , in which there are provided a plurality of sys- 
tem buses and each of said processing modules and said shared storage nrKxiules is provided with a 

45 plurality of connection units which correspond in number to said system buses. 

23. A shared storage duplicating method for specifying a shared storage module conresponding to another 
shared storage module in a computer system comprising a plurality of process modules having at least a 
main memory, a central processing unit, and a connection unit for connection to a system bus; and a 

so plurality of shared storage nvKlules having at least a shared storage unit and a connection unit for con- 

nection to said system bus, comprising steps of: 

dividing shared storage space accessible dependent on a physical address into plural parts of par- 
tially-shared storage space; 

dtvWIng the existence of a duplex configuration of said shared storage module for each part of said 

55 ' partially-shared storage space; and 

specifying another shared storage module having an Inverted value at a specific bit In Its unit ID In 
contrast with said unit ID of saW shared storage module where a duplex configuration is defined, as a cor- 
responding module in a pair of memory modules. 
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24. A Shared storage duplicating method aocording to Claim 23, wherein 

another shared storage module having an inverted value at the least significant bit in its unit ID in 
contrast wfth the unit ID of said shared storage module where a duplex configuration is defined is specified 
as a corresponding module in a pair of memory modules. 

5 

25. A shared storage duplicating method aocording to Claim 23, wherein 

If a duplex configuration Is detemnlned according to a first write Instruction of said central processing 
unit based on the software, the hardware of said connection unit performs a frst write into said shared 
storage module having a specified unit ID. and then a second write into said other shared storage nr>odule 
10 having an inverted value at a specific bit in its unit ID in contrast with said specified unit ID. 

26. A shared storage duplicating method aocording to Claim 23, wherein 

a connection unit in said process module comprises a configuration register for specifying the exist- 
ence of a duplex configuration of said shared storage nrodule, and perfonms an access for a duplicating 
15 write as referring to said configuration definition register on receiving a write instruction from said central 

processing unit. 

27. A shared storage duplicating method according to Claim 23. wherein 

the duplex configuration specified by said configuration definition register can be changed accord- 
20 ing to an insbruction of said central processing unit based on the software. 

28. A shared storage duplicating method according to Claim 23, wherein 

if said connection unit in said process module receives from said central processing unit a read 
instruction from a pair of shared storage modules where a duplex configuration is specified, only a reading 
25 access is performed from the shared storage nrK)dule having a unit ID determined by the read instruction 

of said central processing unit 

29. A shared storage duplicating method according to Clairh 23. wherein 
said connection unit in said process module generates start transmit command (EC) comprising a 

destination ID code (DID) indicating the shared storage module to be accessed, a source ID code (SID) 
for indicating the source, an operand indicating the type of access, and access data capacity (BCT), and 
then sends to said system bus said start transmit command (EC) together with an access address (A) of 
the shared storage nrtodule at the destination; and 

said connection unit in said shared storage module monitors said system bus, and accepts said 
start transmit command (SC) when It determines that the destination ID code of said start transmit com- 
mand (SC) and its unit ID match, thereby perfonming an operand-dependent access. 

30. A shared storage configuration method according to Claim 23, wherein 
said connection unit in said process module comprises as the hardware for performing a duplicating 

write according to the specification of a duplex configuration: 

a program mode access control means for accessing said shared storage module deperulent on a 
physical address of said cenb-al processing unit ; and 

a DMA mode access control means for accessing said shared storage module after converting the 
physical address of said central processing unit to a relative address. 

31. A shared storage duplicating method according to Claim 23. wherein 
if an abnormal condition exists during the access to said shared storage module, a tenmination code 

describing the detailed information of the abnormal condition and the unit ID of the defective shared stor- 
age module are notified to the software of said process module. 

32. A shared storage duplicating method according to Claim 31, wherein 
the software of said process module is notified of the tenmination code describing the detailed infor- 
mation of the abnormal condition and only the least significant bit in the unit ID of the defective shared 
storage module. 

33. A shared storage duplicating method according to Claim 31, wherein 
If the software of said process module receives notification indicating an abnormal termination of 

the duplex access, a recovery process Is perfonmed by selecting the content of said configuration definition 
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register provided in said connection unit, said contents comprising release of duplication, rewrite instruc- 
tion, and switch of a shared storage module to be road. 

34. A shared storage configuration method according to Claim 23, wherein 

5 said computer system comprises a single process module and a plurality of shared storage units 

each t>elng allocated shared storage space accessible dependent on a physical address of said process 
module. 

35. A shared storage configuration method according to Claim 23 comprising: 
10 a plurality of said system buses; and 

a plurality of connection units provided in said process module and a plurality of connection units 
provided in said shared storage nriodule, each provided depending on the number of said system buses. 
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